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SANTRAUKA 

Straipsnyje analizuojama studijij programq vertinimo prielaidos 
siekiant uztikrinti studijg kokybg. Pristatomas ir lyginamas pa- 
rengtij ir teikiamq jgyvendinti 1 neuniversitetinig studijg progra- 
mg vertinimo proceso organizavimas Lietuvoje ir kitose salyse. 
Analizuojamas parengtu. ar teikiamg jgyvendinti neuniversiteti- 
nig studijg programg vertinimas, remiantis kokybiniais ir kieky- 
biniais rodikliais, leidzia nustatyti programos parengimo ir jgy- 
vendinimo kokybp. 

PAGRINDINig SAVOKy APIBREZIMAI 

• Dalykinis vertinimas - studijg dalyko specifinio turinio tinka- 
mumas studijg programai bei atitinkamai studijg krypciai. 

• Isorinis studijg programos vertinimas - nustato teikiamos ar 
jau vykdomos studijg programos, projekto, realizavimo arba ga- 
limybig jq realizuoti kokybq, privalumus ir silpnqsias puses. 

• Kiekybiniai rodikiiai -skaitmenine pozymio israiska, nusakan- 
ti pozymio reiskimosi intensyvumq; tai informaciniai, statistiniai 
duomenys, gauti naudojanttikslius matavimo jrankius pagal pa- 
sirinktqskalq. 

• Kokybiniai rodikiiai - duomenys pozymio turinio vertingumui 
atskleisti. 

• Kriterijus - pozymis, savybe, pagal kurj kas nors vertinama, 
nustatoma vertinamo objekto (studijg programos) kokybe, kla- 
sifikuojama, priimamas sprendimas (jvertinimas). 

• Neuniversitetinig studiju programa -vienos pakopos, j prakti- 
ng veiklq orientuotos profesines studijos aukstojoje mokykloje, 
sudarancios sqlygas jgyti taikomaisiais moksliniais tyrimais ir 
(ar) taikomqja moksline veikla grindziamq profesing kvalifikacijq 
(LR aukstojo mokslo jstatymas, 2000). 

• Reguiiarus studijg programos vertinimas - isorinj vertinimq 
organizuojancios agenturos apibreztas vertinimo cikliskumas, 
kur grieztai reglamentuojama, kada bus pakartotinai vertinama 
jau jgyvendinamos studijg programos kokybe. Taip pat reko- 
menduotinas reguiiarus vidinis studijg programos vertinimas, kurj 
atlieka pati studijg institucija, siekdama geresnes studijg koky- 
bes uztikrinimo sistemos veiklos. 

• Rodikiis -kokybinis ar kiekybinis domuo, apibudinantis ma- 
tuojamg pozymj. 


1 Vertinamas rasytinis dokumentas, o prireikus atliekamas ir 
isplestinis vertinimas ekspertams atvykus j studijg instituci- 
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ABSTRACT 

The author analyzes the nature of study programme assess- 
ment with regard to the assurance of study quality. The or- 
ganisation of the assessment process of the non-university study 
programmes which were developed and submitted for 
realisation 1 in Lithuania and other countries is also presented 
and compared. It is being analysed whether it is possible to 
identify the quality of these programmes based on qualitative 
and qualitative indicators. 

DEFINITIONS OF KEY WORDS 

• Subject assessment - appropriacy of the specific content of the 
study subject, for the study programme and similar study area. 

• External study programme assessment - identification the 
quality of the programme submitted for evaluation or under 
implementation, its benefits and shortcomings, it is assessment 
of its design, realisation or opportunities to realise it. 

• Quantitative indicators - numeric value of the criterion, 
characterising intensity of expression of the criterion; 
informational and statistical data acquired on the basis of using 
objective measurement tools according to the choosed scale. 

• Qualitative indicators -data characterising the value of content. 

• Criterion - a characteristic, feature which is used as the 
reference (comparison standard) for assessment, identification 
to distinguish the quality of the object (study programme), 
classification and judgement. 

• Non-university study programme -one staged practice-oriented 
professional studies at a higher school, which create conditions 
for the acquirement of professional qualification based on applied 
scientific research and (or) applied scientific work (Law on Higher 
Education of the Lithuanian Republic, 2000). 

• Regular study programme assessment- periodic assessment 
defined by the agency, which organises external assessment, 
strictly defining when the repeated assessments of the study 
programme quality will be performed at a higher educational 
institution. It is recommended that the higher educational 
institution itself performs regular internal study programme self- 
assessment to improve the quality assurance system. 


1 A study programme project assessed by written documents, 
or, in need, an extended assessment when experts go to 
the study institution. 
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• Studiju kokybes uztikrinimas- s\s\em'mQos procedures, pa- 
dedancios vertinti irvaldyti institucijos veiklos, studijq progra- 
mq ir dokumentg kokybp. 

• Studijq programos palyginamumas (Benchmarking of pro- 
grammes) - panasiq studijq programq, jos elementq tarpu- 
savio palyginimo pagal standartq galimybe, siekiant atlikti vi- 
sapusiskesnj vertinimq ir pateikti vertingesnes tobulinimo re- 
komendacijas bei pasikeisti gerqja patirtimi. Remiantis Ko- 
penhagos deklaracija (2003), pagrindiniai palyginamumotiks- 
lai: 1) lyginti vienus rezultatus su kitais pagal bendras reko- 
mendacijas, kad butq galima isskirti gerosios patirties pa- 
vyzdzius; 2) nustatyti lygintinus partnerius pagal metodus, 
procesus, mokymo/studijij programas ir paslaugas; pagrjsti 
pripazintus pavyzdzius ir puikq jq pasiekimu lygi; 3) mokytis 
is gerosios patirties pavyzdziq ir pritaikyti juos organizacijoje 
arba sistemoje. 

• Temos vertinimas - pasirinktos temos reiksmingumas studi- 
ju programai ir siekiamai jgyti profesinei kvalifikacijai. 

• Tyrimq vertinimas - objektyviq duomenq rinkimas apie 
fundamentaliosios arba taikomosios mokslines veiklos 
kokybg. 

• Universitetines/neuniversitetines studijq programos vertini- 
mas - sutartinig pozymig visuma, rodanti, kaip ir kokiu budu 
yra tenkinami studijuojanciqjq poreikiai, regioniniai ir europi- 
niai tikslai, atskiros salies nacionaliniuose dokumentuose nu- 
statyti reikalavimai, atsizvelgiant j atsirandancias inovacijas, 
technologijas, ypatingq demesj skiriant asmens kokybiskam 
issilavinimui. 

• Vertinimo mode/is -teorijos irtyrimo pagrindu pagrjstas ver- 
tinimo pavyzdys, kurio pagrindinemis idejomis remiantis ku- 
riama vertinimo strategija (pvz., pagal Tyler, Hammond ir kt. 
vertinimo modelius). 

• Vertinimo patikimumas -tinkamas vertinimo metodologijos 
ir metodikos parinkimas irtaikymas, leidziantis matuoti tai, kas 
yra matuojama, tirti tai, kas norima tirti, ir gauti jrodymais pa- 
grjstus rezultatus, jrodancius, jog rezultatai is tikrgjg yra tokie, 
kokie turi buti pagal vertinimo paskirti. 

• Vertinimo strategija - vertinimo planas, visuma veiksmg, ku- 
riuos vertinimq organizuojancios ir reikalavimus nustatancios 
organizacijos kuria, siekdamos kuo geriau uztikrinti vertinimo 
objektyvumq, skaidrumq, patikimumq, pazangumq. 

• Vidinis studijLj programos vertinimas - kai aukstosios mo- 
kyklos bendruomene bendru susitarimu pagal pasirinktus po- 
zymius sistemingai analizuoja savo veiklq susijusiq su studijg 
programa, nusistato taisytinus dalykus bei studijg programos 
tobulinimo galimybes. Vidinis vertinimas - reiksminga isorinio 
vertinimo dalis. 


jVADAS 

Studijg kokybes poreikis ir visokeriopa parama pletojant 
kokybes uztikrinimo sistem^ instituciniame, nacionalinia- 
me ir europiniame lygmenyse - isryskintas Bolonijos de- 
klaracijoje ( Bologna Declaration, 1999) , o po to ispleto- 
tas Berlyno komunikate ( Berlin Communique, 2003), sie- 
kiant iki 2005 m. jtraukti j nacionalines sistemas studijLj 
programu ir institucinj vertinim^, skatinti vidinj vertinim^, 
pletoti akreditavimq ir studijq palyginimo galimybp. Lie- 
tuvos svietimo sistemai integruojantis j Europos svietimo 
sistemq, vienas is prioritetinig uzdavinig yra studijg ko- 
kybes uztikrinimas. Siekiant Europoje konkurentabilig stu- 


* indicator - qualitative and quantitative characteristic of activity 
outcomes revealing the measured criterion. 

* Quality assurance of higher education - systematic procedures 
which help to assess and manage the quality of institution activi- 
ties, study programmes and action-guiding documents. 

* Benchmarking of programmes -interdependent comparison of 
similar study programmes and their elements according to a given 
standard in pursuit of a more balanced assessment and in order 
to get more valuable recommendations for improvement and 
sharing the best experience. On the basis of the Copenhagen 
declaration (2003), the main benchmarking goals are: 1) to 
compare the outcomes interdependently according to general 
recommendations in order to define the samples of best expe- 
rience; 2) to identify comparable partners according to methods, 
processes, teaching/study programmes and services; to base 
recognised samples and high level of achievement; and 3) to learn 
from the samples of best experience and apply them practically 
in the organisation or system. 

* Thematic assessment - significance of the selected topic for 
the study programme and acquired qualification. 

* Research assess/77e/7/-collecting of objective data about quality 
of activities in basic and applied science. 

* Assessment of university/non-university study programme - set 
of conventional features indicating how and in what way student, 
employer and societal needs are met, regional and European goals 
are reached and national document regulations are fulfilled taking 
into account the changing innovations and technologies and paying 
specific attention to the quality of the education of individuals. 

* Assessment model - theory and research based assessment 
sample with main ideas on which the assessment strategy is 
developed. A possible model of assessment (according to Tyler, 
Hammond, etc.). 

* Validity of assessment - proper selection and application of 
the assessment framework and methodology, which allows to 
measure what is measurable, research what is researchable and 
obtain evidence based outcomes, which provides evidence that 
the outcomes are as they should be according to the purpose of 
the assessment. 

* Assessment strategy -plan of assessment, entity of the actions 
created by the assessment design and aiming at maximal objec- 
tivity, transparency, validity and advancement of assessment. 

* Internal self-assessment of study programme-Vt\e process during 
which the institution, by common agreement, systematically 
analyses its own activities (according to the chosen features) related 
with the study programme; it identifies the remedial shortcomings 
and study programme development opportunities. Internal assess- 
ment is an important part of external assessment. 


INTRODUCTION 

The need to study the quality of higher education - i.e., the 
development of quality assurance systems at the institu- 
tional, national and European levels - is an issue at stake 
highlighted in the Bologna Declaration ( Bologna Declara- 
tion , 1999) and particularly expanded in the Berlin Commu- 
nique (Berlin Communique, 2003); it means seeking to in- 
clude study programmes and institutional assessments into 
national systems, to foster internal self-assessment, and to 
develop accreditation and comparability by 2005. Quality 
assurance is one of the priority objectives in the Lithuanian 
higher education system in order to be integrated into 
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dijq ir tarptautiniu mastu derinant studijq kokybq, ak- 
tualus ir svarbus studijq kokybes vertinimo politikos 
skaidrumas, metodikos pagrjstumas. Sis poreikis 
ypac aktualus Lietuvoje del nepakankamai ispleto- 
tos studijq kokybes vertinimo ir valdymo sistemos. 
Sparti neuniversitetiniq studijq pletra tiek Lietuvoje, 
tiek kitose salyse, aukstojo mokslo virtimas masiniu 
skatina tarptautines diskusijas studijq programq ver- 
tinimo klausimais. 

Moksliniuose tyrimuose studijq kokybes vertini- 
mo ir valdymo klausimams skiriama gana didelis de- 
mesys ne tik atskirose salyse bet ir tarptautiniu mas- 
tu. Aukstojo mokslo studijq kokybes vertinimo ir uz- 
tikrinimo samprata pastaraisiais metais issamiai ana- 
lizuojama (Broadfoot Patricia 1996; Campbell, Ma- 
rijk van der Wende 2000; Cizas 1996, 1999, 2001; 
Stobart and Gipps 1997; Stumbrys 2003; Tidikis 
1998; Vengris 1998; Vroeijenstijn 1995). Vis labiau 
akcentuojamas studijq kokybes internacionalizavimo, 
vertinimo ir suteikiamos kvalifikacijos pripazinimo po- 
reikis ( Berlin Communique 2003, Campbell, Marijk 
van der Wende 2000; The Danish Evaluation Institu- 
te 2003; Thune 2002). Neuniversitetiniq studijq pro- 
gramq kokybes valdymo ir vertinimo klausimai daz- 
niausiai tiriami bendrajame aukstojo mokslo konteks- 
te, taciau gali buti isskiriami ir atskirai. Studijq pro- 
gramq rengimo ir vertinimo problemos neuniversite- 
tiniame lygmenyje uzsienyje jau seniai nagrinejamos 
(Losak John, Burns Neil 1971), taciau Lietuvoje sis 
darbas dar tik pradedamas. Neuniversitetiniq studi- 
jq programq rengimo, vertinimo ir jgyvendinimo pro- 
blemas tiria Zibeniene (2002; 2003a), neuniversiteti- 
niq ir universitetiniq verslo studijq sanglaudq, kom- 
petencijq pletojimo lygj analizuoja Lepaite (2001, 
2002), komandinio darbo kompetenciju didaktinq 
diagnostic ir jos vystymq rengiant slaugytojus - Zy- 
dziunaite (2003). Kritinis poziuris j neuniversitetiniq 
studijq programq ir institucijq kokybes vertinimo sis- 
temq (daugiausiai organizacinius aspektus) atsispin- 
di Misiuno ir Tutlio (2003) straipsnyje. Taciau issa- 
miau neanalizuojama, kokios vertinimo problemos ir 
del kokiq priezasciq kyla, atliekant neuniversitetiniq 
studijq programq vertinimq. Tokios analizes poreiki 
isryskina pastarqjq metq tyrimai. Lietuvos aukstqjq 
mokyklu studentq ir absolventu sociologinio tyrimo 
(2003), taip pat Zibenienes (2002; 2003), Zydziunai- 
tes (2003) tyrimq duomenimis kolegijq absolventai 
pasigedo praktiniq ziniq suteikimo ir jgudziq forma- 
vimo. Be to, is tyrimq ryskeja tai, kad neuniversiteti- 
niq studijq programa turi buti orientuota j praktinq 
veiklq, taciau remiantis minetais tyrimais siose stu- 
dijq programose pastebima didesne orientacija j te- 
orijq, bet ne j praktikq, nors sudarant ir vertinant sias 
programas buvo ypac siekiama, kad studijos butq 
kuo daugiau orientuotos j praktinq veiklq. 

Straipsnio tikslas- isanalizuoti parengtu ir teikiamq 
jgyvendinti neuniversitetiniq studijq programq kokybes 
vertinimo problemas remiantis Lietuvos patirtimi. 

Tyrimo objektas- parengtq ir teikiamq jgyvendinti 
neuniversitetiniq studijq programq vertinimas. 

Tyrimo metodar. mokslines literaturos, dokumentq 
analize, anketine apklausa, ekspertq metodas. 


the corresponding European system. The transparency of 
the study quality evaluation policy and the validity of the 
methodological approaches are urgent and relevant issues 
in order to offer competitive studies on the European level 
and to adjust the quality of the studies to the international 
level. This need becomes particularly relevant given the cur- 
rent insufficiently developed study quality assessment and 
management system in Lithuania. Rapid development of non- 
university studies both in Lithuania and in other countries 
and higher education becoming more important enhance 
the discussion about study programme assessment issues 
on the national as well as on the international levels. 

Researchers pay considerable attention to the assess- 
ment of the study quality and on quality management issues 
on the national and international levels. The concept of higher 
education study quality assessment and management has 
been broadly discussed recently (Broadfoot M. Patricia, 1996; 
C. Campbell, Marijk van der Wende, 2000; A. Cizas 1996, 
1999, 2001; G. Stobart and C. Gipps, 1997; E. Stumbrys, 
2003; S. Tidikis, 1998; S. Vengris, 1998; A. Vroeijenstijn, 
1995). During the past few years the need for study quality 
internationalisation, assessment and qualification recogni- 
tion has been more and more emphasised (Berlin Commu- 
nique, 2003; C. Campbell, Marijk van der Wende, 2000; The 
Danish Evaluation Institute, 2003; Ch. Thune, 2002). The is- 
sues of non-university study programme quality management 
and assessment are analysed in the common context of 
higher education, however, sometimes they are also dis- 
cerned as separate problems. Study programme develop- 
ment and assessment problems on a non-university level 
abroad have been analysed for a long time (J. Losak, N. 
Burns 1971), but in Lithuania these analyses have just started. 
The development, assessment and realisation problems of 
non-university study programmes were investigated by G. 
Zibeniene (2002, 2003a); the coherence of non-university 
and university business studies and the development of com- 
petency levels were studied by D. Lepaite (2001 , 2002); the 
didactical diagnostics of team work competencies and their 
development in nurse education and training were re- 
searched by V. Zydziunaite (2003). A critical approach to non- 
university study programmes and institutional quality assess- 
ment systems with the focus on organisational aspects was 
reflected in the article by M. Misiunas and V. Tutlys (2003). 
However, neither the problems that arise in performing non- 
university study programme assessment nor their causes 
have been investigated in depth. 

The need for the present analysis was highlighted by the 
recent years researches. According to the data presented by 
the sociological research into the Lithuanian higher educa- 
tion students and graduates (2003), the research data pre- 
sented by G. Zibeniene (2002; 2003) and V. Zydziunaite (2003), 
college graduates lack practical knowledge and skills. Among 
others, the above mentioned research emphasises that non- 
university study programmes have to be oriented to practical 
activity. However, these analyses have shown that these study 
programmes are more oriented to theory than practice, al- 
though, during the programme development and evaluation 
the focus on practical activity was taken into account. 

The aim of the article is to analyse the problems arising 
in the assessment of the quality of the non-university study 
programmes which were developed and submitted for the 
realisation on the basis of the Lithuanian experience. 
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Visos 1999-2002 metais Lietuvoje parengtos 294 
studijq programos jvertintos ekspertq metodu pagal 
isskirtus kokybinius ir kiekybinius rodiklius (pasta- 
rqju isskyrimq leme neuniversitetinems studijoms ke- 
liami reikalavimai, reglamentuojami Lietuvos Respub- 
likos Svietimo ir mokslo ministerijos (LR SMM) bei 
Lietuvos Respublikos Vyriausybes dokumentais). 
Kiekvienq studijq programq vertino 4-5 asmenys. 
Kompetentingi atitinkamos studiju krypties darbda- 
viq ir aukstqjq mokyklij atstovai vertino dalykini turi- 
nj. Profesinio mokymo metodikos centro darbuoto- 
jai vertino atitikimq dokumentams, reglamentuojan- 
tiems neuniversitetines studijas. Duomenys analizuoti 
matematiniais statistiniais metodais, taikant kompiu- 
terizuotq programq Paula (Bitinas 1998). 

Tyrimo metodologinj pagrindq atskleidzia tokios 
nuostatos: 

• Studijq programos vertinimas - viena is studijq 
kokybes uztikrinimo sistemos daliq; 

• Curicutum teorijos realizavimas - kokybiskos 
studijq programos pagrindas (Lauzackas 2000; Kerr 
1967; Tyler 1949). 

Straipsni sudaro keturios da/ys. Pirmojoje daly- 
je siekiama pagrjsti studijq programq tarptautinio 
vertinimo prielaidas siekiant uztikrinti studijq koky- 
bg. Antrojoje dalyje lyginami parengtq ir teikiamq 
jgyvendinti neuniversitetiniq studijq programq ver- 
tinimo pozymiai Lietuvoje ir kitose salyse. Treciojo- 
je dalyje analizuojamas siu neuniversitetiniq studi- 
jq programq vertinimas, o ketvirtoje dalyje - remian- 
tis kiekybiniais ir kokybiniais rodikliais, neuniversi- 
tetiniq studijq programq vertinimo proceso organi- 
zavimas Lietuvoje. 

1 

STUDIjy PROGRAMOS VERTINIMAS - 
STUDIjy KOKYBES UZTIKRINIMO 
PRIELAIDA 

Rinkos ekonomikos ir ziniu visuomenes (Drucker, 
1993) poreikiai, „brgstantis“ naujas aukstojo mokslo 
sektorius, aukstojo mokslo masiskejimas, tyrinetas 
Barnett (1990); Gudaitytes (1998, 2000, 2002), Ju- 
cevicienes (1998), tarptautine patirtis turejo jtakos 
neuniversitetiniq studijq programq rengimo ir ju ko- 
kybes vertinimo principq formulavimui bei kintanciam 
poziuriui j svietimo kokybg. Lietuvos svietimo siste- 
mai integruojantis j pasauling svietimo erdvg, vienas 
is prioritetiniq uzdaviniq yra studijq kokybes uztikri- 
nimas, kurio viena reiksmingq sudedamqjq daliq - 
studiju programu kokybes vertinimas. Daugelyje sa- 
liu, ypac Europos Sqjungos, sukurtos ir veikia nuo- 
lat tobulinamos studijq kokybes vertinimo sistemos. 

Dazniausiai studijq kokybes vertinimas atliekamas 
studijq programos arba institucijos lygyje, kartais pa- 
sirenkamas dalykinis, teminis, tyrimu ar kt. vertini- 
mas. Taciau vertinant institucijq visada svarbi verti- 
nimo dalis yra studijq programq organizavimo, to- 
bulinimo, valdymo vertinimas. Reguliarus institucinis 
ir studijq programq vertinimas atliekamas Austrijoje, 
Bulgarijoje, Vokietijoje, Suomijoje, Vengrijoje, Airijo- 


The research object is the assessment process of the 
non-university study programmes developed and submit- 
ted for realisation. 

The research methods were applied: scientific literature 
analysis, document analysis, questionnaire survey, expert 
method. All 294 study programmes developed in Lithuania in 
1999 through 2002 were evaluating using expert method. Ac- 
cording to the qualitative and quantitative indicators determined 
by the requirements for non-university study programmes, regu- 
lated by the Ministry of Education and Science of the Lithua- 
nian Republic (LR MES) and the Government of the Lithuanian 
Republic. Each study programme was assessed by 4-5 asses- 
sors. Competent representatives of employers and higher edu- 
cation schools, representing the corresponding study field as- 
sessed the subject matter content and employees-experts from 
the Methodological Centre for Vocational Education and Train- 
ing assessed the adequacy of the programmes with respect to 
the documents regulating non-university studies. The data were 
analysed using mathematical-statistical methods applying the 
computerised programme Paula (B. Bitinas, 1998). 

The methodological background of the research is 
based on the following premises: 

• Study programme assessment is one part of the study 
quality assurance system; 

• The realisation of the Curriculum theory is the basis 
for a qualitative study programme (R. Lauzackas, 2000; F. 
Kerr, 1967; R.W. Tyler, 1949). 

The article consists of four parts. In the first part the justi- 
fication for the internationalisation presumption of the study 
programme assessment with regard to quality assurance is 
provided. In the second part the comparison of the assess- 
ment characteristics of the programmes which were devel- 
oped and submitted for realisation in Lithuania and other 
countries is performed. In the third and fourth parts the as- 
sessment of the non-university study programmes on the 
basis of qualitative and quantitative indicators is analysed 
and the organisation of non-university study programme 
assessment is analysed. 


1 

STUDY PROGRAMME ASSESSMENT 
AS A PRESUMPTION FOR QUALITY 
ASSURANCE OF HIGHER EDUCATION 

The demands of the market economy and knowledge soci- 
ety (R Drucker, 1993), the ..maturing" new sector of higher 
education - a binary system with higher education being 
more massive were researched by R. Barnett (1990); D. 
Gudaityte (1998, 2000, 2002), R Juceviciene (1998), and oth- 
ers. The international situation has exerted impact upon the 
development of non-university study programmes and on 
the formulation of their quality assessment principles as well 
as upon a change of the attitude towards quality in educa- 
tion. Quality assurance of studies is one of the priority objec- 
tives related with the aim of integrating the Lithuanian sys- 
tem of higher education into the world education area and 
of the assessment of the study programme quality. Quality 
assessment systems of studies have been created, are in 
effect and are constantly improved in many countries. 

Quality assessment of studies is usually performed on the 
study programme or institutional level, sometimes applying 


AUKSTOJO MOKSLO KOKYBE • THE QUALITY OF HIGHER EDUCATION • 2004/1 


je, Latvijoje, Olandijoje, Rumunijoje. Reguliarus is- 
orinis neuniversitetiniu studijij programij vertinimas 
vyrauja Belgijoje, Kipre, Cekijoje, Estijoje, Danijoje, 
Norvegijoje, Lenkijoje, Ispanijoje, Svedijoje {The Da- 
nish Evaluation institute 2003). 

Studijij program q vertinimo klausimai analizuoti Al- 
kin, McNeil (2002), Losak John, Burns, Neil (1971); 
Spiel (2002) ir kituose saltiniuose. Taip pat yra anali- 
zuotas vertinimo proceso organizavimas bei vertini- 
mo metodLj ir procedurq parinkimas, vertinimo objek- 
tyvumas uztikrinimas, vertinimo mokslinis pagrindimas 
(Berk, Rossi, 1998; Brophy, Alleman, 1991; Losak 
John, Burns Neil, 1971 ; Spiel 2002; The Program Eva- 
luation Standards). Taciau si analize isryskina tik ati- 
tinkamq saliq prioritetinius vertinimo pozymius (Camp- 
bell, Rozsnyai 2002; Pukelis, Savickiene 2003; The 
Centre for Quality Assurance and Evaluation of Hig- 
her Education, 1998), kuriuos, anot Spiel (2002), sq- 
lygoja vis dar nenusistovejusios, kintancios studijij 
programos vertinimo strategijos. Visa tai kyla del to, 
jog „naujq pedagoginiq ideju taikymui priesinamasi 
intensyviau negu daugelio kitij sriciu idejoms“ (Biti- 
nas 2000, p. 56-57). Jvairiu vertinimo agenturu, orga- 
nizacijij leidiniuose ir internetiniuose puslapiuose bei 
mokslineje literaturoje galima rasti studiju programij 
vertinimui taikomas jvairias, net nevienodai apibrezia- 
mas sqvokas: standartas, kriterijus, rodik/is, indikato- 
rius, aspektas, dimensija ir kt. Sios srities lietuviskq 
terming interpretavimas edukologijos moksle lig siol 
kelia diskusijas. Placiausiai siq problemq analizavo Ju- 
ceviciene (2003), nagrinedama Europos svietimo te- 
zauro daromq jtakq ir is to kylancias problemas. Ka- 
dangi siame straipsnyje bus vartojamos dvi sqvokos: 
aspektas 1 bei rodikiis J , todel aptariami tik siu sqvoku 
pasirinkimo motyvai. Kitij saliq studijij programij ver- 
tinimo agenturq parengtoje literaturoje gana daznai 
vartojama sqvoka „aspektai‘\ kurie, kaip teigia Savic- 
kiene, Pukelis „...yra studijij kokybes dimensijos” 
(2003, p. 36). Remiantis „Dabartiniu lietuviij kalbos zo- 
dynu” (2000) aspektas - „poziuris, kuriuo koks nors 
dalykas, reiskinystiriamas, svarstomas”. Vadinasi, as- 
pektas turetq atspindeti vertinamqjj poziurj. Taciau at- 
liekant kitij saliq literaturos ir dokumentu analizq pa- 
stebeta, kad aspekto turinio apimtis skiriasi (jvairiose 
salyse vertinimo aspektu apimtys ir prasmes yra skir- 
tingos). Vienose salyse studijij programij vertinimui 
taikoma nedaug aspektu, taciau placiai apimanciq ir 
kitus vertinimo pozymius. Pvz., Anglijoje taikomi tik 
penki aspektai parengtai ir siekiamai jgyvendinti stu- 
dijij programai vertinti: 1) Curriculum sudarymas, tu- 
rinys ir organizavimas; 2) mokymas, mokymasis ir ver- 
tinimas; 3) parama studentams ir konsultavimas; 4) 
mokymo/si istekliai 5) studijij kokybes uztikrinimas ir 
stiprinimo perspektyvos ( The Quality Assessment Met- 
hod from April 1995). Kai kuriose salyse keli atskiri 
aspektai apima vieno kitoje salyje taikomo aspekto 
vertinimo sudarancius pozymius (pvz. Anglijoje ir Suo- 
mijoje). Todel isorinio studiju programos vertinimo Lie- 


2 Atzvilgis, kuriuo nagrinejamas daiktas, reiskinys, sqvoka 
- (Tarptautiniij zodziij zodynas, 1985). 

3 Veiklos rezultatij, kokybes ir kiekybes israiska, duomuo 
(Dabartines lietuviij kalbos zodynas, 2000). 


subject, thematic, research and other form of assessment . 
But on the institutional level the assessment of the study proc- 
ess (study programme organisation, improvement, manage- 
ment) is always an important part. Regular institutional and 
programme assessments are performed in Austria, Bulgaria, 
Germany, Finland, Hungary, Ireland, Latvia, Holland, and Ro- 
mania, among others. Regular external programme assess- 
ment (of non-university studies) prevail in Belgium, Cyprus, 
the Czech Republic, Estonia, Denmark, Norway, Poland, Spain, 
Sweden (The Danish Evaluation Institute, 2003). 

The resources of M.C. Alkin, J.D. McNeil (2002), J. Losak; 
N. Burns (1971), C. Spiel, (2002) and others were analysed on 
the issues of study programme assessment. Organisation of 
assessment process and the choice of assessment methods 
and procedures, assurance of objectivity and validity of as- 
sessment and scientific justification of assessment were also 
analysed (R. Berk, 1998; A. Brophy, 1991; J. Losak and N. 
Burns, 1971; C. Spiel, 2002; The Program Evaluation Stand- 
ard. Is) . These analyses highlighted the characteristics of assess- 
ment applied in the corresponding countries (C. Campbell and 
C. Rozsnyai, 2002; Pukelis, Savickiene, 2003; The Centre for 
Quality Assurance and Evaluation of Higher Education, 1 998) , 
which are affected, according to C. Spiel (2002), by still incon- 
sistent and changing study programme assessment strategies. 
This can be justified by the fact that “the resistance to the ap- 
plication of new didactical ideas is more intensive than to ideas 
in other fields“(B. Bitinas, 2000, p. 56-57). In the publications 
and internet pages of various assessment agencies and or- 
ganisations and in scientific sources it is possible to find vari- 
ous concepts - even inadequately defined - applied in the 
study programme assessment : standard, criterion, indicator, 
aspect, dimension, and etc. The interpretation of the terms in 
the educational science and the Lithuanian language has raised 
a need for discussion. The broadest discussion on this prob- 
lem was provided by R Juceviciene (2003, December) when 
analysing the impact and problems of the European educa- 
tional thesaurus. As two concepts will be used in this research 
article - aspecf and indicator *, - only the motives underlying 
the choice of these terms will be presented. 

The concept of “aspect” is often used in the literature pre- 
sented by the study programme assessment agencies in other 
countries. This concept, as stated by I. Savickiene, K. Pukelis 
“...is dimension of study quality” (2003, p. 36). On the basis of 
the Contemporary Dictionary of the Lithuanian Language 
(2000), an aspect is an approach to investigate or discuss any 
subject or phenomenon. In the assessment context, this means 
that an aspect should reflect an assessment nature of the ap- 
proach. However, the performed analysis of literature sources 
and documents of other countries has revealed that “aspect” 
differs in its content range (in various countries the range and 
meaning of the aspects of assessment are different). In some 
countries not many aspects are used for study programme 
assessment, however, these aspects are broadly spread into 
other assessment features. For instance, in England only five 
aspects are applied to assess a developed and submitted for 
realisation programme: 1) Curriculum designing, content and 
organisation; 2) Teaching, learning and assessment ; 3) Stu- 


2 respect in which the thing, phenomenon or concept is investi- 
gated - (tarptautiniij zodziij zodynas, 1985). 

3 expression, data of quality and quantity indicators (Dabartines 
lietuviij kalbos zodynas, 2000). 
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tuvoje strategijos kurimo procese svarbu apibrezti 
studijg prog ram os vertinimui taikomas sqvokas, jypa- 
naudojimq, turini ir apimtj. Siekiant pristatyti vertini- 
mo pagrindq tarptautiniq ir atskirq saliu vertinimo 
agenturq dokumentuose, informacineje medziagoje, 
paplitgs vertinimo pozymiq atskleidimas pasitelkiant 
sqvokq aspektai. Atsizvelgiant j literatures analizq pa- 
sirinktq lyginimui, sqvokos aspektas pazodinj verti- 
mq is anglq kalbos, taip pat analizuotoje literaturoje 
aptiktq vartojimo daznumq (Pukelis, Savickiene 2003; 
The Centre for Quality Assurance and Evaluation of 
Higher Education 1998 ir kt.) siuo atveju apsisprgsta 
toliau straipsnyje vartoti siq sqvokq. Pasirinkto as- 
pekto lygiui konkretizuoti, gali buti taikomas vertini- 
mas pagal kitus pozymius, pvz., rodiklius (angl. indi- 
cators). Galima teigti jog sqvokos rodikiis'w indikato- 
riusf', sutampa savo reiksme verciant jas is anglq kal- 
bos, taciau lietuviskas siq sqvokq aiskinimas skiria- 
si. Todel pastaruoju atveju pasirinktas lietuviskesnis, 
tinkamesnis variantas - rodikiis. 

Remiantis Spiel (2002) studijq programas vertinti pri- 
reikia siekiant jrodyti ir pagrjsti jq vertingumq, veiksmin- 
gumq ir rezultatyvumq bei studijq tikslq aiskumq, tiks- 
lingumq ir pasiekiamumq arba empiriskai jrodyti pro- 
gramos tobulinimo butinumq. Studijq programu verti- 
nimo butinumq pagrindzia curriculum teorijos tyrineto- 
jai (Lauzackas 1999, 2000; Tyler 1949 ir kt.). Remiantis 
curricuiunf teorija, vieno is jos pradininku nuomone, 
bet kuris programos vertinimo procesas, net planavi- 
mo turetq prasideti nuo mokymo/studijq tikslq vertini- 
mo (Tyler 1949, p. 1 10). Curriculum teorijos tyrinetojas 
Lietuvoje Lauzackas (2000) labiau akcentuoja patj mo- 
kymo turinio atnaujinimo nepertraukiamumo procesq, 
pabrezdamas judejimq ratu, „kuriame logiskas sio ne- 
sibaigiancio proceso iseities taskas yra veiklos siste- 
mos reikalaujamu kvalifikacijq tyrimas, o pabaigos tas- 
kas - mokymo turinio jvertinimas ir jdiegimas" (2000, 
p. 24-25). Sios nuostatos glaudziai siejasi su nuolati- 
niu, sistemingu jvairiq studijq kokybes komponentq ver- 
tinimo poreikiu ir strategija, atsispindincia europiniuo- 
se dokumentuose. Remiantis literatures analize, tarp- 
tautine studijq kokybes vertinimo ir valdymo politika bei 
curriculumXeof\\a, isryskeja tikroji esme- nuolatinis pro- 
gramos vertinimas jvairiuose etapuose yra svarbi stu- 
dijq kokybes uztikrinimo sistemos dalis. 


4 Medziaga spalvos kitimu ar kitais pozymiais rodanti tarn 
tikro junginio buvimq (Dabartines lietuviq kalbos zody- 
nas, 2000). 

5 Del sqvokos atitikmens dar iki siol Lietuvos moksli- 
ninkai neturi vienos nuomones. Sj klausim^ meginu- 
siq sprgsti Lauzacko (2000) bei Pukelio (1999) nuo- 
mone, lietuviskoje ugdymo moksiq terminijoje curri- 
culum neturi tiesioginio ir tikslaus atitikmens. Gana 
skirtinga ir nevienareiksme curriculum samprata uz- 
sienyje: nuo piano mokymuisi iki mokymo tikslq, turi- 
nio, metodq, medziagos ir priemoniq, mokymo orga- 
nizavimo ir kontroles sistemos, iki nepertraukiamo ir 
tolygiai kintancio proceso (Holmen, McLean 1967; 
John Kerr 1967; Pukelis 1999). Pagal teorijos pradi- 
ninko ir propaguotojo Ralf W. Tyler studijq, cituojama 
Lauzacko (1 999, 2000) ..curriculum" - j tikslus orien- 
tuota mokymo programa. 


dent support and counselling; 4) Teaching/learning resources; 
5) Quality assurance of studies and enhancement perspec- 
tives ( The Quality Assessment Method from April 1993) . In some 
countries several separate aspects are used for the assess- 
ment of the features revealing an aspect treated as one in an- 
other country (e.g. in England and Finland). Therefore, in the 
development of an external study programme assessment strat- 
egy in Lithuania it is necessary to define the concepts used in 
the study programme evaluation, their use, content and range. 
It is popular broadly to use the concept ’’aspect” to reveal the 
characteristics of assessment; the term “aspect” is found in 
the international documents and the documents of the national 
assessment agencies in other countries and in their informa- 
tional materials presenting the background of assessment. Tak- 
ing into account the performed comparative literature analy- 
sis, the verbatim translation from the English language of the 
concept “aspect”, and the frequency of the use of this term in 
the analysed literature (K. Pukelis, I. Savickiene, 2003; The Cen- 
tre for Quality Assurance and Evaluation of Higher Education, 
1998 and others), we choose to use this concept. 

To concretise the chosen aspect level, the assessment 
according to other features, such as indicators, can be ap- 
plied. The English concept indicator in Lithuanian has two 
meanings and the Lithuanian explanation of these concepts 
differ. Therefore, the term “rodikiis” most close to “index” 
understanding in English) was chosen as it is more suitable 
for our understanding. 

According to C. Spiel (2002), study programme assess- 
ment originated from the need to provide evidence or show 
the need to improve the value of a programme, its efficiency 
and usefulness, as well as the purposefulness, clarity and 
achievability of the study goals. The necessity of the need for 
teaching programme assessment was grounded by curricu- 
lum theory researchers (R. Lauzackas, 1999, 2000; R. W. Tyler, 
1949 and others). On the basis of curricuiunf theory and ac- 
cording to one of its originators, any programme assessment 
process including planning should start from the assessment 
of teaching/study goals (R.W. Tyler, 1949, p.110). R. Lauzac- 
kas (2000), a curriculum theory researcher in Lithuania, em- 
phasises the process of sustainable curriculum renewal, high- 
lighting the circular movement “in which the logical point of 
reference of this continuous process is qualification research, 
demanded by activity systems, and the ending is curriculum 
assessment and realisation" (2000, p. 24-25). These ideas are 
closely related to a constant and systematic need for assess- 


4 Material which (...) shows the existence of a certain combination by 
other features (Dabartines lietuviq kalbos zodynas, 2000). Indicator 
shows presence of criterion, “rodikiis” - quantity of criterion in appro- 
priate scale of measurement. 

5 There has not been consistent opinion regarding the equivalent of 
the concept in Lithuania yet. According to the researchers R. 
Lauzackas (2000) and K. Pukelis (1999), who analysed this issue, in 
the Lithuanian educational terminology ..curriculum" has no direct 
and full equivalent. In foreign countries there has always existed a 
rather different and multi-sided ..curriculum" concept: from plan for 
learning, from courses to teaching goals, content, methods, material 
and means, teaching organisation and control system, sustainable 
and gradually changing process from the outset of teaching (B. 
Holmen, M. McLean 1967; John F. Kerr 1967; K. Pukelis, 1999). Ac- 
cording to the study by Ralf W. Tyler, an originator and advocator of 
the theory, cited by R. Lauzackas (1 999, 2000) ..curriculum" is a goal- 
oriented teaching programme. 


AUKSTOJO MOKSLO KOKYBE • THE QUALITY OF HIGHER EDUCATION • 2004/1 


2 

NEUNIVERSITETINig 
STUDIjg PROGRAMg 
VERTINIMO ASPEKTAI 

Analizuojant jvai ri q stud ij q kokybes vertinimo 
agenturq dokumentus (The Centre for Quality Assu- 
rance and Evaluation of Higher Education 1998) bei 
atskirq tyrinetojq darbus (Campbell, Rozsnyai 2002; 
Pukelis, Savickiene 2003), pastebeta, kad nera ais- 
kiai ir konkreciai atskiriama kurie aspektai taikomi 
parengtai ir teikiamai jgyvendint studijq programai, 
o kurie jau vykdomai studijq programai. Mokslineje 
literaturoje pazymima tik parengtos, bet dar nejgy- 
vendinamos, o taip pat ir jau jgyvendinamq studijq 
programq vertinimo metodikij ir metodq analizes sto- 
ka (Lepaite 2003). Tik analizuojant vertinimo aspek- 
tu turinj isryskeja, kurie jq svarbus tiek parengtai ir 
jau jgyvendinamai studijq programai, o kurie -tik pa- 
rengtai programai. 1 lenteleje apibendrinti aspektai, 
taikytini parengtos studijq programos vertinimui, re- 
miantis Austrijos, Jungtine Karalystes, Olandijos, 
Suomijos, JAV patirtimi bei Pukelio, Savickienes 
(2003) analize. 

Neuniversitetiniu studijq programij vertinimo as- 
pektai Lietuvoje ir kitose salyse yra panasus, taciau 
pastebeta keletas esminiq skirtumu, svarbiq visapu- 
siskam studijq kokybes uztikrinimui ir sios srities tarp- 
tautinei politikai (1 lentele). Siuo atveju svarbu isskirti 
siuos aspektus: didaktine koncepcija irfilosofija; mo- 
kymo proceso projektavimas, mokymo metodai; stu- 
dijq turinio irtternacionalizavimas; studijq kokybes 
sistemos pietojimas ir uztikrinimas. Didaktine kon- 
cepcija ir filosofija bei mokymo metodai yra labai 
svarbus sekmingoms neuniversitetinems studijoms 
Lietuvoje. Remiantis 1999 m. tyrimo, kuriame daly- 
vavo ir aukstesniosios mokyklos, isaugusios j kole- 
gijas, duomenimis, dazniausiai kyla sios problemos: 
pedagoginis personalas turi aukstqjj issilavinimq, bet 
neturi didaktines kvalifikacijos, stokoja mokymo tikslq 
nustatymo kompetencijos, mokymo turinio, mokymo 
metodq planavimo gebejimu, organizuodami moky- 
mosi procesq nejvertina studijuojanciqjq mokymosi 
poreikiq (Lauzackas 2002). Ekspertu vertinimo duo- 
menimis ir pirrmi|ji| neuniversitetiniq studijq progra- 
mq absolventq nuomone, didaktiniai elemental, taip 
pat ir mokymo metodu taikymas turi buti tobulina- 
mas (Zibeniene 2003b). Studijq turinio internaciona- 
lizavimo idejos atsiradimui jtakos turejo studijq ko- 
kybes uztikrinimo politikos tendencijos. Remiantis 
Marijk van der Wende, cituojama Jucevicienes 
(2003), studijq internacionalizavimas - sistemingos, 
harmoningos pastangos, siekiant, kad aukstasis 
mokslas labiau atitiktq visuomenines, ekonomines ir 
darbo rinkos globalizacijos issukius. Kreditu perke- 
limo (angl. credit transfer) idejos, deklaruojamos Ko- 
penhagos deklaracijoje ( Copenhagen Declaration 
2002) - tai indelis studijq internacionalizavimo link. 
Kitas svarbus aspektas, reiksmingas instituciniam 
vertinimui Lietuvoje - studijy kokybes sistemos ple- 
tojimas ir uztikrinimas, taciau per mazai j jj atsizvel- 


ment of various components of quality of studies and its strat- 
egy reflected in the European documents. Literature analysis, 
international assessment of quality of studies and manage- 
ment policy and curriculum theory lead to the emergence of 
the essential principle: constant assessment of the programme 
(at various stages) is an important part of the quality assur- 
ance of study system. 

2 

ASPECTS OF NON-UNIVERSITY 
STUDY PROGRAMME ASSESSMENT 

The analysis of the documents of various study quality as- 
sessment agencies (The Centre for Quality Assurance and 
Evaluation of Higher Education, 1 998) and works by individual 
researchers (C. Campbell and C. Rozsnyai, 2002; K. Pukelis, 
I. Savickiene, 2003) showed that there is no clear and con- 
crete distinction between the aspects to be used for study 
programmes which are being developed and submitted for 
realisation and for those which are currently carried out. The 
scientific literature underlines the lack of analyses of the meth- 
odologies and methods to assess both types of programmes 
(D. Lepaite, 2003). The analysis of the content of the assess- 
ment aspects reveals which aspects are important for the study 
programme to be developed and under realisation and which 
ones for the developed programme. Aspects summarised in 
Table 1 are applied for the developed study programme as- 
sessment on the basis of the experiences in Austria, the United 
Kingdom, Holland, Finland, the USA and the analysis by K. 
Pukelis and I. Savickiene (2003). 

Non-university study programme assessment aspects in 
Lithuania and other countries are similar; however, several 
differences have been noticed that are important for well- 
rounded study quality assurance and international policy in 
this area (Table 1). Deficits in Lithuania and hence the need 
for special attention can be found with respect to didactical 
conception and philosophy; teaching process designing, 
teaching methods; internationalisation of study content; de- 
velopment and assurance of study quality systems. 

Didactical conception and philosophy and teaching meth- 
ods are important for successful non-university studies in Lithua- 
nia. On the basis of the data of the 1999 research, where the 
research participants were vocational advanced schools that 
grew up to colleges, the most frequent problems were as fol- 
lows: the pedagogical personnel has a higher education but 
lacks didactical qualification, competence to determine teach- 
ing goals, skills in teaching content, teaching method planning, 
undervalues learner learning needs in the organisation of the 
teaching process (R. Lauzackas, 2002). According to expert 
assessment data and the opinion of the first non-university study 
programme graduates, didactical elements and application of 
teaching methods calls for development (G. Zibeniene, 2003b). 

The emergence of the idea of internationalisation of study 
content was caused by the tendencies in the study quality 
assurance policy. On the basis of Marijk van der Wende (cited 
by R Juceviciene, 2003), study internationalisation requires 
systematic and harmonious efforts in higher education to re- 
spond more adequately to the challenges of societal, eco- 
nomic and labour market globalisation. The credit transfer 
ideas declared in the Copenhagen Declaration (2002) con- 
tribute to study internationalisation. 


Gintaute ZIBENIENE 

PARENGTU IR TEIKIAMU IGYVENDINTI N E U N I V E R SIT ETI N I U STUDIJU PROGRAMU ISORINIO KOKYBES VERTINIMO PATIRTIS IR PROBLEMOS 
EXTERNAL QUALITY ASSESSMENT OF NON-UNIVERSITY STUDY PROGRAMMES WHICH WERE DEVELOPED AND SUBMITTED FOR REALISATION: EXPERIENCE AND PROBLEMS 


1 lentele. Vertinimo aspektai, taikomi Lietuvoje ir uzsienio salyse parengtoms ir teikiamoms jgyvendinti neuniversitetiniu studijq programoms 
Table 1. Comparison of the foreign external assessment aspects of the non-university study programmes which were developed and submitted 

for the implementation with the aspects applied in Lithuania 


UZSIENIO SALYSE/ 

IN FOREIGN COUNTRIES 

LIETUVOJE/ 
IN LITHUANIA 

Pasiruosimo bei galimybiLj studijLj programai vykdyti santykis su jgyvendinimo realumu 
Relation between the preparation and opportunities to carry out the study programme 
and its implementation in reality 

Studijq programos reikalingumo pagrindimas 
Justification of the necessity for the study programme 

StudijLj programos tikslai ir uzdaviniai 
Study programme goals and objectives 

+ 

Studijq programos turinys 
Study programme content 

+ 

Studijq programos struktura ir vidutine studijq trukme 
Study programme structure and average duration of studies 

+ 

Didaktine koncepcija irfilosofija 
Didactical conception and philosophy 

— , bet numatoma 
— , but foreseen 

Mokymo proceso projektavimas, mokymo metodai* 
Teaching process designing, teaching methods* 

Iki 2003 m., dabar nepakankamai 
Until 2003, now insufficiently 

Studijq turinio projektavimas 
Study content designing 

+ 

Studentq vertinimas, egzaminavimas (numatomas) 
Student assessment, examination (foreseen) 

+ 

Akademinio personalo kvalifikacija ir veikla (jskaitant kurybiskumq, tiriamqjj darbq ir pan.) 
Academical personnel qualification and activity (including creativity, research work and etc.) 

Vertinimo lygis** 
Level of evaluation** 

Materialine, metodine baze ir informacines technologijos 
Material, methodological basis and information technologies 

Vertinimo lygis pasirenkamas** 
Level of evaluation is chosen** 

Vidines studijq kokybes vertinimo ir uztikrinimo sistema 

Internal self-evaluation of quality of studies and management system 

Vertintos uzuomazgos 6 
Rudiments evaluated 6 

Studijq turinio internacionaiizavimas 
Internationalisation of study content 

— 

Studijq turinio suderinamumas su naujausiais pasiekimais bei veiklos pasaulio 
poreikiais (darbdaviq nuomone) 

Compatibility of study content with the latest achievements and the demands 
of the world of work (employer opinion) 

+ 

Destytojq nuomone 
Teacher opinion 

Vertinimo lygis pasirenkamas** 
Level of evaluation is chosen** 

Neaptikta duomenq 
No data found 

Oficialiq profesiniq jstaigq nuomone (pagal poreikj) 
Opinion of official professional institutions (according 
to the need) 

Neaptikta duomenq 
No data found 

Pavadinimo, kvalifikacijos atitikmuo turiniui (uzsienyje kitq 
aspektq vertinimo dalis) 

Correspondence of the title, qualification to the content (in 
foreign countries a part of assessment of other aspects) 

Neaptikta duomenq 
No data found 

Atitikimas SMM reglamentams 

Adequacy to regulations of the Ministry of Education 

and Science 

Studijq kokybes sistemos pletojimas ir uztikrinimas 
Development and assurance of study quality system 

Daugiau svarbu instituciniame vertinimo iygmenyje 
More important in institutional evaluation 


* Kai kuriuose saltiniuose studijq metodai / Study methods in some sources. 


** Galima isskirti du lygmenis: issamusis, kai vertinama nuvykus j institucijq, kurioje bus jgyvendinama studijq programa ir doku- 
mentinis vertinimas, kai ekspertas vertina pagal mokyklos pateiktus dokumentus. 

It is possible to discern two levels: comprehensive, when assessment is performed in the institution where the study programme will 
be implemented; documentary assessment when an expert assess the documents submitted by the institution. 


Kolegijos skiria demesj studijq kokybei, jkurusios studijq 
kokybes palaikymoskyriusar padalinius, (Misiunas, 1999; 
Misiunas, Savickiene, 2002; Stasiulioniene, 2003). 


Colleges pay attention to study quality by establishing study 
quality maintenance departments or divisions (M. Misiunas, 
1999; M. Misiunas, I. Savickiene, 2002; V. Stasiulioniene, 2003). 
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giama programq lygmenyje, taciau studijq kokybes 
suderinamumo tarptautiniu mastu poreikis (tiek ins- 
tituciniame, tiek programq lygmenyse) pabreziamas 
ir mokslininkij Lietuvoje (Stumbrys 2003). 

Lyginant studijq programq vertinimo aspektus Lie- 
tuvoje su dazniausiai paplitusiais kitose salyse, pa- 
stebeta sqsajq, kurios rodo nemazq Lietuvos moks- 
lininku indelj diegiant studijq kokybes uztikrinimo sis- 
temq. Galima isskirti siekiamq tikslq kai vertinimo pro- 
cese visais atvejais dalyvauja socialinis partneris - 
atitinkamos srities ekspertas, ypac tinkanciq neuni- 
versitetiniq studijq specifiskumui, - orientacijai j prak- 
tinq veiklq. 

3 

PARENGTy IR TEIKIAMy JGYVENDINTI 
NEUNIVERSITETINiy 
STUDIjy PROGRAMy 
VERTINIMO PROCESO 
ORGANIZAVIMAS LIETUVOJE 

Pagal organizavimo pobudi isskiriamas dvejopo po- 
budzio naujq neuniversitetiniq studiju programij ver- 
tinimas: 1) dokumentq analize; 2) vizitas j studijq ins- 
titucijq, kurioje numatoma jgyvendinti neuniversiteti- 
niq studijq programq. 

Studijq programos dokumentq vertinimas. Neu- 
niversitetiniq studijq programq dokumentq vertini- 
mas daznai yra jvadine, taciau kartais lieka vienin- 
tele pagrindine programq vertinimo dalis. Taciau ver- 
tinimo objektyvumui uztikrinti nepakanka vien eks- 
perto kvalifikacijos ir dokumentq vertinimo nuoro- 
du. Panasiu objektu palyginamumo principas (siuo 
atveju lyginama su visomis panasiomis programo- 
mis) ir Europoje plintancios [Copenhagen Declara- 
tion 2002; The Danish Evaluation institute 2003) pro- 
gramq paiygininamumo (regioniniu lygmeniu) ide- 
jos (Benchmarking of programmes), isryskintq ver- 
tinimo objektyvumq. Taciau studijq programq verti- 
nimui Lietuvoje visa tai taikoma vangiai ir tik pavie- 
niais atvejais. 

Vizitas j institucijq kurioje numatoma jgyvendin- 
ti studiju programa. Steigiant kolegijas po studijq 
programos dokumentq vertinimo, reikejo jvertinti ne 
tik siq institucijq pasirengimq naujam aukstosios 
mokyklos statusui, bet ir studijq programos jgyven- 
dinimo galimybq. Po kolegijos statuso suteikimo vi- 
zitas i siq institucijq buvo organizuojamas atsiradus 
naujai studijq krypciai ar pagal poreikj. Toks prin- 
cipas taikomas ne tik Lietuvoje, bet ir kitose salyse. 
Taciau skirtumq yra, nes neuniversitetiniq studijq 
programq vertinimas Lietuvoje buvo organizuoja- 
mas atskirose institucijose, o demesys kreipiamas 
j bendrq galimos aukstosios mokyklos lygj. Si pasi- 
rinkta vertinimo strategija leido pastebeti studijq pro- 
gramq spektrq mokykloje, taciau nebuvo ar buvo 
nepakankamai sudaryta galimybe to paties pava- 
dinimo studijq programq turiniui palyginti. Neuni- 
versitetiniq studijq programq, jq kokybes vertinimas 
labiau isryskintq studijg programp palyginamumo 


Another important aspect, which is more taken into ac- 
count in the institutional evaluations in Lithuania but still are 
not sufficiently developed on the programme level, is the de- 
velopment and assurance of study quality systems. The need 
for study quality to be comparable with international stand- 
ards (both in institutional and programme levels) is also em- 
phasised by researchers in Lithuania (E. Stumbrys, 2003). 

Comparing study programme aspects in Lithuania with 
the aspects which are regarded as most relevant in other 
countries makes it possible to notice fair input of Lithua- 
nian researches to provide a good base for the develop- 
ment and realisation of an appropriate quality assurance 
system in Lithuania. Could be distinguished the goals to 
be achieved in evaluation process when a social partner is 
an expert in the relevant area participates in the process of 
assessment in all the cases, which particularly suits the 
specific needs of non-university studies from the orienta- 
tion towards the practical activities. 

3 

ORGANISATION OF THE ASSESSMENT 
PROCESS OF THE NON-UNIVERSITY STUDY 
PROGRAMMES WHICH WERE DEVELOPED 
AND SUBMITTED FOR REALISATION 
IN LITHUANIA 

According to the organisational nature of new non-univer- 
sity study programmes, their assessment can be divided 
into documentary assessment and field visits to the educa- 
tional institutions. 

Documentary assessment of study programme. Docu- 
mentary assessment of a non-university study programme 
is often an introductory but sometimes the only and main 
evaluation part. However, the qualification of the experts and 
evaluation guidelines are usually insufficient for the docu- 
mentary assessment to be objective. The principles of com- 
parability of similar objects (in this case comparison with all 
similar programmes) or of Benchmarking of programmes 
outspreading in Europe (Copenhagen Declaration, 2002; The 
Danish Evaluation institute, 2003) on the regional level would 
highlight the objectivity of assessment. However, these prin- 
ciples are hardly applied or only in single cases of assess- 
ment of study programmes in Lithuania. 

Field visits to institutions implementing study programmes. 
In the college establishment process, after documentary as- 
sessment, not only the preparation of the institution for a new 
higher education school status was assessed but the oppor- 
tunities for study programme realisation as well. Having con- 
ferred a college status, an external visit was performed if new 
study areas were introduced or on demand. Such practice is 
applied not only in Lithuania but in other countries as well. In 
contrast to the latter, in Lithuania the assessment of non-uni- 
versity study programmes was organised according to insti- 
tutions, paying attention to the general level of the respective 
higher school. The chosen assessment strategy allowed to 
see the range of study programmes at school, however, the 
opportunities for the comparison of the contents of the study 
programmes under the same title were not or insufficiently 
created. The quality level of non-university study programmes 
would have been more highlighted by the principle of 
benchmarking of study programmes in the institution or re- 
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institucijoje, regione principq, jei vertinimas butq or- 
ganizuojamas tokiu paciq ar panasiq studijq pro- 
gramq palyginamumo principu. Taip pat nebuvo tai- 
komi siuolaikineje vertinimo sistemoje populisms 
palyginimo elementai pagal nusistatytq poziurj, eta- 
loninj pavyzdj, siekiamq standartq. Steigiant kole- 
gijas, aukstesniosios mokyklos pasirengimo tapti 
aukstojo mokslo institucija vertinimas ir pasirengi- 
mo jgyvendinti neuniversitetines studijas pagal jvai- 
rias parengtas studijq programas vertinimas vyko 
vienu metu, t. y. atitiko ekonomiskumo-taupumo bei 
greitumo funkcijas. Taciau tai skatino netiesioginj 
kolegijos statuso sutapatinimq su teigiamu pareng- 
tos ir teikiamos jgyvendinti programos vertinimu, o 
pasauline praktika rodo, kad institucijos naujq ko- 
kybinj laiptelj - kolegijos statusq pasiekia laipsnis- 
kai jgyvendindamos naujas studiju programas. 


4 

NEUNIVERSITETINig STUDIjg 
PROGRAMg VERTINIMAS LIETUVOJE, 
REMIANTIS KOKYBINIAIS 
IR KIEKYBINIAIS RODIKLIAIS 

Siekiant jvertinti studijq programq kokybq pasaulyje 
taikomi tiek kiekybiniai, tiek kokybiniai rodikliai (Al- 
kin, McNeil 2002), kurie apibendrinami kaip informa- 
ciniai statistiniai ir/arba aprasomieji matmenys ir pa- 
deda nustatyti stud ij q programos kokybq, sudaro 
prielaidas numatyti esamus ar galimus trukumus. 
Neuniversitetinig studiju programq vertinimo rodik- 
liu isskyrimq (2 lentele) Lietuvoje sqlygojo specifiniai 
reikalavimai neuniversitetinems studijoms. Pozymiai 
vertinti trijq balq skaleje [atitinka, is daiies atitinka, 
neatitinka ). Rodikliai suskirstyti j kiekybinius ir koky- 
binius. 

Vertinant studijq programas pagal kiekybinius ro- 
diklius ekspertq nuomones sutapo. Vertinimo patiki- 
mumui pagal siuos rodiklius jtakos turejo formalizuo- 
ta studijq programos forma ir aiski vertinimo metodi- 
ka su rodiklio pasiekimo lygj padedancia parodyti 
vertinimo skale. Taciau vertinime pasitelktq terming 
reiksmiq formalizavimo nejtvirtinimas sudare sqlygas 
atsirasti siame vertinime nepageidautinoms interpre- 
tacijoms. 7 Del studijq programos empiriskumo, auks- 
tojo mokslo autonomiskumo vien kiekybiniais rodik- 
liais pagrjstas vertinimas netikslingas ir net ydingas 
siekiant jvertinti studijq programos turinj. 

Studijq programos ir atskiro studijq dalyko turi- 
niui, studijq kokybei vertinti reiksmingi kokybiniai ro- 
dikliai bei turinio analize. Apibendrinant savarankis- 
kus ekspertq vertinimus paaiskejo, kad dalis kokybi- 
niu rodikliu buvo jvertinti gana vienodai: atitikimas 


7 Pvz. altematyvus dalykai kartais buvo tapatinami su lais- 
vai pasirenkamais, laisvai pasirenkami su specializacijos 
dalykais. Si duomenu patikimumui turinti jtakos proble- 
ma buvo sprendziama, skiriant dar vienq ekspertq kieky- 
biniam vertinimui perziureti. 


gion and organising the assessment of the same or similar 
study programmes accordingly. The set approach, the use of 
standard samples and of pursuable standard, which are ele- 
ments of comparison popular in contemporary assessment 
practice, were not applied. In the process of the creation of 
colleges two approaches were implemented simultaneously: 
the evaluation of the preparation of the vocational advanced 
school to become an institution of higher education and the 
evaluation of the preparation to perform non-university stud- 
ies according to various study programmes; this was done 
for reasons of economical-prudence and rapidity. However, 
this enhanced indirectly the identification of college status with 
positive evaluation of the programmes which were developed 
and submitted for realisation, whereas the world practice indi- 
cates that institutions reach a new qualitative level - in this 
case, the status of college - by gradually realising new study 
programmes. 
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ASSESSMENT OF NON-UNIVERSITY STUDY 
PROGRAMMES IN LITHUANIA ON THE BASIS 
OF QUALITATIVE AND QUANTITATIVE 
INDICATORS 

In the pursuit to assess the quality of study programmes, 
typically, both qualitative and quantitative indicators are 
used (M.C. Alkin and J.D. McNeil, 2002) and provided as 
statistical and/or descriptive information to help to define 
the quality of study programmes and create preconditions 
for the identification of current and possible future draw- 
backs. Specific requirements for non-university studies in 
Lithuania helped to distinguish non-university study prob- 
lem indicators (Table 2). The features were evaluated by a 
three-point scale (corresponds, partly corresponds, does 
not correspond). Indicators are grouped into quantitative 
and qualitative ones. 

When using the quantitative indicators for the assessment 
of study programmes, the experts’ evaluations coincided. Re- 
liability of assessment with these indicators was enhanced by 
a formalised study programme form and clear assessment 
methodology with an assessment scale, which helped to indi- 
cate the indicator achievement level. However, lack of formal- 
ised fixation of the meanings of terms used in the assessment 
led to undesirable interpretations in the quantitative assess- 
ment 7 . Due to the empirical nature of the study programme 
and to the autonomy of higher education, assessment based 
solely on quantitative indicators is inexpedient and even flawy 
for study programme content evaluation. 

Qualitative indicators and content analysis acquire a spe- 
cific importance in the assessment of a study programme, the 
content of a separate subject and the quality of the studies. 
Generalisation of independent expert assessment revealed that 
some qualitative indicators were evaluated rather unanimously: 
adequacy to professional education standard; adequacy of 


7 E.g., alternative subjects were sometimes mixed with 

electives, electives with specialisation subjects. This prob- 
lem affects data validity and it was solved by obliging an 
additional person to review the quantitative assessment. 
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2 lentele. Neuniversitetiniq studiju programtj kokybiniai ir kiekybiniai rodikliai 
Table 2. Qualitative and quantitative indicators of non-university study programmes 


Neuniversitetiniq studijq programq kokybiniai rodikliai 
Qualitative indicators of non-university study programmes 

1 . Ar studijq programos tikslai atitinka profesinio rengimo standartq (V profesinio issilavinimo lygis)? 

Do study programme goals precisely correspond to professional standard (level 5 of vocational education)? 

2. Ar studijq programos tikslai atitinka kitus norminius dokumentus? 

Do study programme goals correspond to other normative documents? 

3. Ar studijq tikslai aiskiai suformuluoti? 

Are study programme goals formulated in a clear way? 

4. Ar studijq programos tikslai siejami su asmens igyjamu issilavinimu, ziniomis, jgudziais ir profesine kvalifikacija? 

Are study programme goals related with the educational background, knowledge, skills and professional qualification acquired by the person? 

5. Ar pakanka numatytq dalykq studijq tikslams pasiekti (pagal sqrasq ir apimtj)? 

Is the number of subjects sufficient to achieve the study goals (according to the list and scope)? 

6. Ar studijuojamq dalykq turinys ir tikslai atitinka studijq programos tikslus? 

Do the content of the study subjects and their objectives correspond to the study programme goals? 

7. Ar suteikiama kvalifikacija atitinka studijq programos kryptj? 

Does the provided qualification correspond to study programme field? 

8. Ar mokymo metodai atitinka studijq programos tikslus? 

Do the teaching methods correspond to study programme goals? 

9. Ar studijq programoje nurodyta akademinio personalo kvalifikacija yra pakankama studijq programos tikslams pasiekti? 

Is the qualification of academical personnel indicated in the study programme sufficient to achieve programme goals? 

10. Ar nuosekli destomq dalykq seka? 

Is the sequence of the provided subjects consistent? 

1 1 . Ar dalykq turinys novatoriskas, t.y. ar studentai supazindinami su naujausiais mokslo, technikos, technologijq ir pan. pasiekimais? 

Is the subject matter content innovative, i.e. are the students acquainted with the latest achievements of science, technologies, etc.? 

12. Ar baigiamasis studijq rezultatq vertinimas leidzia nustatyti, jog studijq tikslai yra pasiekti? 

Does the final study outcome evaluation allow for the identification of the achieved study goals? 

13. Ar neakivaizdiniq studijq programos apimtis ir dalykq sudetis tapati dieninems studijoms? 

Is the scope and composition of the subjects in part-time extramural study programmes adequate to full-time study programmes? 

14. Ar vakariniu studijq programos apimtis ir dalykq sudetis tapati dieninems studijoms? 

Is the scope and composition of the subjects in part-time evening classes study programmes adequate to full-time study programmes? 

15. Ar studijq programoje nurodyti materialiniai istekliai yra pakankami studijq programos tikslams pasiekti? 

Are material resources indicated in the study programme sufficient to achieve study programme goals? 

16. Ar studijq programa parengta pagal Svietimo ir mokslo ministerijos nustatytq formq? 

Is the study programme developed according to the form defined by the Ministry of Science and Education? 

17. Ar specializacijos atitinka studijq programq? 

Are specializations appropriate to the study programme? 

Neuniversitetiniq studijq programq kiekybiniai rodikliai 
Quantitative indicators of non-university study programmes 

1 . Ar studijq dalykq apimtis nera mazesne nei 2 kreditai? 

Is the extent of study subjects no less than 2 credits*? 

2. Ar studijuojamq dalykq skaicius per semestrq nedidesnis kaip 7? 

Is the number of study subjects per semester not higher than 7? 

3. Ar bendrojo lavinimo dalykq apimtis ne mazesne kaip 30 kreditq? 

Is the extent of general education subjects no less than 30 credits? 

4. Ar dalykq apimtis profesinei kvalifikacijai jgyti ne mazesne kaip 40 kreditq? 

Is the extent of subjects to acquire professional qualification no less than 40 credits? 

5. Ar specializacijos dalykq apimtis ne mazesne kaip 10 kreditq? 

Is the extent of specialization subjects no less than 10 credits? 

6. Ar profesines veiklos praktikos apimtis ne maziau kaip 20 kreditq? 

Is the extent of professional activity practice no less than 20 credits? 

7. Ar praktinis mokymas sudaro ne maziau kaip trecdalj studijq programos apimties? 

Does practical training take no less than one third of the study programme extent? 

8. Ar baigiamajam darbui parengti skirta ne maziau kaip 6 kreditai? 

Are no less than 6 credits allotted for the preparation of the final project? 

9. Ar savarankiskas darbas sudaro ne maziau kaip 20 proc. studijq programos apimties? 

Is independent work no less than 20% of the study programme extent? 

10. Ar laisvai pasirenkami dalykai sudaro ne maziau kaip 5 proc. studijq programq apimties? 

Do the elective subjects take no less than 5% of the study programme extent? 


1 credit equals 40 hours of independent student workload or 1 ,5 ECTS credit 
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profesinio rengimo standartui; kvalifikacijos atitiki- 
mas; neakivaizdiniu ar vakariniu studijq tapatumas 
dieninems studijoms, neuniversitetiniq studijq progra- 
mos parengimas pagal nustatytq formq. Taciau liku- 
siems kokybiniams rodikliams budingas gana 
priestaringas vertinimas. Viena priezasciq yra tai, kad 
ekspertai atstovauja skirtingiems lygmenims: univer- 
sitetiniam, kolegijos, socialiniq partneriu ir renkami 
atsizvelgiant j ju kompetentingumq profesineje srity- 
je. Taciau vertinimo grupeje nebuvo programq ren- 
gimo eksperto, galincio jvertinti metodinius studijq 
programos aspektus. Taigi analizuojant vertinimo re- 
zultatus, isaiskejo, kad priestaringam vertinimui pa- 
gal atskirus rodiklius jtakos turejo: kokybiniq rodik- 
Hij jvairumas ; vienpusiskas vertintojg grupes suda- 
rymo principas. 

Kokybiniu rodiktiu jvairove. Gana priestaringas at- 
skiru rodikliq, pvz., studijq metodq vertinimas, isrys- 
kino vertinimo rodikliq jvairovq, sukelusiq aiskumo 
problem^, t.y. rodiklis aiskus destytojui, taciau ne- 
suprantamas socialiniam partneriui. Atsizvelgiant j 
kokybiniq rodikliq specifiskumq, juos visus butq tiks- 
linga sugrupuoti dar pagal kelis pozymius j didakti- 
nius ir studijq turinio. Net puikiausiai didaktikq isma- 
nantis ekspertas negali vertinti konkrecios studijq 
programos turinio, taciau jis kompetentingas vertin- 
damas socialiniam partneriui sunkiau suvokiamq 
studijq metodq taikymo tinkamumq ar studijq tikslq 
aiskumq . 8 

Vienpusiskas vertintojL / sudarymo principas. Atsi- 
zvelgiant j tai, kad neuniversitetines studijq progra- 
mos orientuotos j kompeteneijas ir pabreziamq kom- 
peteneijq vertinimq, ekspertai buvo parenkami pagal 
pagrindinj kriterijq: profesinj ir dalykinj programos is- 
manymq. Kokybes rodikliq specifiskumo analize (di- 
daktiniai bei studijq turinio) rodo, kad reiketq tobulinti 
ekspertu grupes sudarymo principus, pvz. programq 
rengimo specialist^, didaktq jtraukti j bet kurios studi- 
jq programos vertinimo process Lig siol vertinimui pa- 
sirenkami jvairiq kompetentingq institueijq rekomen- 
duoti ekspertai atsizvelgiant j pasiekimus profesineje 
ir dalykineje srityje, taciau beveik neatsizvelgiama j ju 
didaktikos ismanymq. Todel dalis specialybes zinovq 
negalejo kvalifikuotai jvertinti studijq programos ko- 
kybes pagal kokybinius rodiklius. 

Remiantis atlikto vertinimo patirtimi, galima teig- 
ti, kad studijq programos vertinimui svarbu: moks- 
liskai pagrjsta vertinimo organizavimo ir jgyvendini- 
mo metodika; patikimi vertinimo rodikliai; eksperto 
kompetentingumas. Kiekybiniai ir kokybiniai vertini- 
mo rodikliai svarbus ir papildo vienas kitq, taciau 
jiems reikalingas moksliskai pagrjstas studijq progra- 
mos vertinimo modelis ir strategija, jei siekiame vi- 
sapusisko, kvalifikuoto tyrimo. 


Kuris remiasi atitinkamais pozymiais: turi tiksliai nu- 
sakyti galutini siekiamq rezultatq, siekimo s^lygas; buti 
studijuojanciojo laukiamo rezultato vertinimo kriteriju- 
mi; logiskai issidestyti pagal pasiekimo sudetingumo 
lygius; jvertinti pagal sudetingump (pvz., taksonomi- 
j^) ir tris pagrindines tikslq sritis: pazinimo, emocinp 
ir psichomotoring, visoms minetoms sglygoms pasiekti 
butinos didaktines zinios. 


extramural or evening classes studies to full-time studies, prepa- 
ration of non-university study programme according to a set 
form. However, the remaining qualitative indicators yielded rather 
contradictory evaluations. One of the reasons lies in the fact 
that the experts had different education levels and backgrounds: 
university, college, social partners who were selected with re- 
spect to their competence in vocational education and training 
area. However, there were no programme development experts 
in the assessment group who could have assessed study pro- 
gramme aspects from a methodological point of view. Thus, 
analysing the assessment outcomes, it is evident that contra- 
dictory judgments using separate indicators were caused by: 
variety of qualitative indicators; single-sided principle of com- 
posing an assessment group. 

Variety of quantitative indicators. A rather contradic- 
tory assessment of separate indicators, e.g. teaching 
method evaluation, revealed the problem of variety of in- 
dicators which caused the problem of lack of clarity, i.e. a 
given indicator is clear for a teacher but not for a social 
partner. Taking into account the specificity of quantitative 
indicators, they could be grouped according to some other 
features: didactical; study content, etc. An expert who has 
knowledge in didactics cannot assess the content of a 
concrete study programme, but he or she is competent to 
evaluate the appropriacy of the teaching methods or clar- 
ity of the study goals that are hard to understand for a 
social partner 8 . 

Single-sided principle of composing an assessment group. 
Taking into account the aim of non-university study pro- 
grammes to achieve competencies and focusing the assess- 
ment on whether opportunities for qualification acquisition are 
created, experts were selected according to the major crite- 
rion: professional and subject knowledge. The analysis of the 
specificity of quantitative indicators (didactical and study con- 
tent) revealed the importance of improving the principles of 
composing an expert group, e.g. programme developer and 
expert in didactics should be included in the assessment of 
any study programme. Up to now, experts recommended by 
various competent institutions were selected for the assess- 
ment with respect to their achievements in professional sub- 
ject area, however, with no respect to their know-how in 
didactical area. Therefore, a number of connoisseurs in their 
speciality could not evaluate programme quality according to 
qualitative indicators in a sufficient way. 

On the basis of the experience of the performed evalua- 
tion, the following seems important for study programme as- 
sessment: scientifically grounded assessment organisation 
and performance methodology; valid assessment indicators; 
and competence of experts. Quantitative and qualitative as- 
sessment indicators are important and supplement each 
other; however, considering assessment a complex type of 
research, they call for scientifically grounded strategy and 
methodology of study programme. 


Which is based on the following features: has to clearly define 
the final targeted outcome, conditions for its achievement; be 
an assessment criterion of learner expected outcome; place 
logically in the order of difficulty to achieve levels; to assess 
according to the complexity (e.g., taxonomy) and three major 
areas of goals - cognition, emotion and psycho-motor, conse- 
quently, didactical knwoledge is necessary to achieve the vari- 
ous conditions mentioned above. 


AUKSTOJO MOKSLO KOKYBE • THE QUALITY OF HIGHER EDUCATION • 2004/1 


ISVADOS 

1. Nuolatinis studijq programu vertinimas jvairiuose 
etapuose yra svarbi studijq kokybes uztikrinimo sis- 
temos dalis. Jos atskaitos taskas - parengtos studi- 
jq programos vertinimas. 

2. Parengtij ir teikiamq jgyvendinti neuniversiteti- 
niu studijq programq vertinimo aspektai Lietuvoje ir 
uzsienyje panasus, taciau atliekant vertinimq Lietu- 
voje nepakankamas demesys skiriamas keletui me- 
todiskai svarbiq aspektu: didaktinei koncepcijai ir fi- 
losofijai; mokymo procesui ir, moky mo/si metodams; 
studiju turinio internacionaiizavimui; studijq kokybes 
sistemos pietojimui ir uztikrinimui. 

3. Siekiant parengtij ir teikiamij jgyvendinti neu- 
niversitetiniu studijij programu sekmingam vertinimui 
Lietuvoje svarbu: tobulinti strateginius, organizaci- 
nius ir metodinius principus. Organizuojant, vertini- 
mq ypac svarbu iskelti: studiju program q paiygina- 
mumo\ moksiiskai pagristos vertinimo metodikos po- 
reikj taip pat programu rengimo ekspertq, didakti- 
kos specialist a jtraukti j bet kudos studijij programos 
vertinimo procesq. 


CONCLUSIONS 

1. Sustainable assessment of study programmes (at vari- 
ous stages) is an important part of a quality assurance sys- 
tem of studies, and the assessment of the developed study 
programme is its point of reference. 

2. The aspects of the assessment of the non-university study 
programmes which were developed and submitted for realisa- 
tion in Lithuania and in foreign countries are similar, however, in 
Lithuania, insufficient attention is devoted to the assessment of 
some methodologically important aspects: didactical compe- 
tence and philosophy; teaching process and teaching/learn- 
ing methods; internationalisation of the study content; devel- 
opment and assurance of the study quality system. 

3. Successful assessment of the non-university study pro- 
grammes which were developed and submitted for realisa- 
tion call for the improvement of strategic, organisational and 
methodological principles. Particular areas need to be dis- 
cussed, especially in organisation of assessment: 
benchmarking of study programmes; need for scientifically 
grounded assessment methodology; inclusion of a pro- 
gramme developer-expert, a specialist in didactics, in the 
assessment of any study programme. 
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